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Introduction 


Many  methods  have  been  proposed,  tested  and  employed  for  generating 
pseudorandom  numbers  ([2],  [3],  [Uj,  [5],  [7],  [ 9 J , flO],  [12],  [13]). 

The  goal  is  to  produce  strings  of  numbers  which  behave  like  independent 
uniform  [Q,l]  random  variables.  The  generators  yield  integers  in  the 
set  {0,...,m-l}  which  are  then  transformed  to  [Q,l]  by  division  by  m . 
Suppose  that  X^,X0,...  and  Y^.Yg,...  are  strings  of  numbers  in 
generated  by  two  separate  generators.  Assume  that  the  two 
strings  are  independent.  Define  a new  string  of  numbers  Z^,Z^, . . . by 

2i  = Xi  + Yi  ^mod  m^'  F°r  any  K and  corresPondin6  i.,,...,i.  define 

X = (X.  ,...,x.  ) , Y = (Y,  ,... ,Y.  ),  Z = (Z.  Z.  ) . Let  r be  the 

il  1k  X1  1k  11  1k 

distribution  of  k independent  random  variables  uniformly  distributed 

on  {0, . . . ,m-l}  . We  consider  several  natural  measures  of  distance  between 

multivariate  distribution  with  components  in  {0,...,m-l}  and  show  under 

these  distances  that  Z.  , ...,Z.  has  a distribution  closer  to  r than 

X1  1k 

either  X.  , • * * ,X.  or  Y,  , « * » > Y . for  all  k , i , . . ■ , i,  . 

1 k 1 k IK 

In  applying  our  results  to  pseudorandom  number  generation,  two  points 
need  careful  scrutiny.  First,  we  assume  that  the  two  strings,  X and  Y , 
are  independent.  Secondly,  X , Y and  Z are  deterministic , even 
though  they  are  being  constructed  to  look  random.  This  creates  a problem 
in  the  interpretation  of  Lemma  1 and  in  the  interpretation  of  independence. 
We  certainly  do  not  claim  that  our  results  prove  that  addition  mod  (m)  of 
separately  generated  sequences  improves  pseudorandom  number  generation. 

We  only  assert  that  thi3  conclusion  is  suggested  and  warrants  further  study. 
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The  technique  of  combining  strings  by  addition  mod  m is  also  men- 


tioned in  Knuth  ([5],  p.  30).  An  exercise  at  the  end  of  the  section 
(p.  33)  shows  that  if  the  periods  of  X and  are  A^,  Ag  with  A^ 
and  Ag  relatively  prime,  then  the  period  of  Z is  A.^  • This  implies 
that  we  should  choose  the  periods  of  the  separate  generators  to  be  rela- 
tively prime. 

Random  number  generators  are  generally  studied  by  statistical  tests 
on  the  output,  and  by  mathematical  analysis  of  the  period.  We  hope  that 
the  methods  employed  here  will  provide  another  approach  to  analyzing 
pseudorandom  number  generators. 

Results 

Suppose  that  X = (X^...^)  and  Y = ^.....Y.)  are  independent 
random  vectors  with  Pr(X1=J1,  X2=J2*  •••»  xk=Jk)  = » 

Pr  (Y^Jl.^,  y2=A2,  ....  ~ qt^, . . . ,£fc)  ; each  component  assumes 

values  in  {0,...,m-l}  . Define  Z = (Z^,...^)  with  Zj  = X.^  + 

) . As  measures  of 

departure  of  a distribution  b on  X {0,...,m-l}.  , from  r the  distri- 

i=l  1 

bution  of  k independent  uniforms  on  {0  ,... ,m—  l)  , we  use: 

(i)  llb-r||a=  I Jk)--rf  » l<a<«, 

(ii)  ll*>-r|L  = max  |b(  ^ , . . . ,Jk)  - -U  , 

( ’ • • • »Jk ) m 

(iii )  n(b,r ) = l b(j ,. .. ,JV)  log(mkb(j1,...,J  ))  . 

(Jx Jk)  ik 


(mod  m),  and  PrtZ^*^,  ...,  Zj^^m^)  = s(m^ 
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Quantity  (iii)  is  the  mean  information  in  favor  of  b against  the 


distribution  r (see  Kullback  [6],  p.  5);  II(b,r)  achieves  a minimum  of 
0 at.  b = r and  is  otherwise  positive. 

Lemma  1:  For  1 <_  a <_  » , j|s  - r||a  £ min(||p-r||a,||q-r||a)  , and 
Il(s,r  ) <_  min(II(p,r)  ,II(q,r ) ) . 

Proof  of  Lemma  1:  We  rely  heavily  on  the  technique  of  majorization  ([l], 

[8],  [ll]).  Firstly,  adding  Y to  an  independent  random  variable  is 
equivalent  to  making  a transition  in  the  Markov  chain  with  transition  matrix 

=rUrJi(mod  m)*  VJ2(fllodni) Wmod  m))  * 

Now  l Pf  . wo  £ ) “ , l r(m  ,...,n>  ) = 1 

( (m. , . . . ,m^)  ranges  through  the  m sample  points  achieving  each 
exactly  once).  Therefore  P is  doubly  stochastic.  Next,  s = pP  with  P 
doubly  stochastic  and  it  thus  follows  from  a theorem  of  Karamata  ([l],  pg.  31 ) 
that  s is  majorized  by  p . By  definition  this  means  that  if  s and  p 
are  rearranged  so  that  s(q)  iL8(2)  — ***  — and 

J J 

P(l)iP(2)i  — iP(>k)  • iL  •(!)  - Jj  p<i>  for 


k mm 

J = 1,2,. ...m  -1  , and  £ s,.,=  l P(i)- 

i*l  i=l  ' 1 


It  follows  from  the  definition  of  majorization  that  if  s is  majorized 

by  p then  s - 4 is  majorized  by  p - 4r  . For  1 < a ^ , |x|a  is 

mK  ffl 

continuous  and  convex;  it  then  follows  from  [l],  p.  30,  that 

lls  -rlla  i llp-Hla  • 
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From  the  definition  of  majorization,  we  know  tnat  while 


s , > p . Therefore 

(mk)  " (mk) 


|s  - rjl^  = max (s 


1 1 


ur?  jr-Vt*  sr-v,’  - n«-'i 


“ k 

Finally,  the  function  F(x  ,...,x  ) = £ x login  x.)  satisfies 

J mK  i=i  1 1 


(vx3>(!^-  iy)  ■ (vV  loe  jji 


i=l 

0 for  Xj  > x. 


It  then  follows 


i - ~J 

from  a theorem  of  Ostrovski  ([l],  p.  32)  and  the  majorization  of  s by  p 
that  H(s,r)  <_  II(p,r)  . 

3y  reversing  the  roles  of  X and  Y it  follows  that 
IIs  _rlla  i Ik-HIjj  . 1 i a £ “ » and  n(s,r)  < n(q,r)  . This  concludes 

the  proof. 

Undoubtedly  our  result  will  hold  for  many  other  metrics. 

If  we  take  an  independent  sequence  of  random  vectors  X ....  X ,... 

“|1 

n 

and  form  partial  suras  (mod  m),  Z = £ X (mod  m),  n = 1,2,...  , we 

i=l  _i 

will,  under  weak  conditions,  converge  at  a geometric  rate  to  r . ThiB 
follows  from  standard  Markov  chain  analysis. 

More  specifically,  assume  that 


"in , , Pr(ia),i'Ji x(o,k^k) 

^ • * J ^ / 


for  all  i . Then,  letting  s denote  the  distribution  of  Z , it 

n 

follows  that 


max  s (J  ,...,J  ) - min  »(j,...,J  )<  I (l  - mkA. ) 

0 1 k n 1 k “i-1  1 


< (1  - mkd)n  + 0 


as  n -*•  00  . 


For  interpreting  this  result,  note  that 


max  s (J  ) - min  ) 

,<nl  K /,  .,nJ.  k 


^1’* ' • 


(j^ » • • • , ) 


max 


• . • sj^)»(&2** * * »^k^ 


3n^l Jk*  “ *n*ti"'"V 


-(v“  V 


The  proof  is  simple.  Let  M = max  s (j,  ) and 

n n 1 k 

m = min  a (j  . Then 

n , v n l k 

VJj  f • • • > / 


M < M (1  - (mk-l)A  ) + A (l  - M ) * M (l  - mkA  ) + A , 
n — n-l  n n n— l n— 1 n n 


while 


m > m , (l  - (mk-l)A  ) + A (l  - m)  = m (l  - mkA  ) + A . 
n — n-1  n n n-1  n-1  n n 


Thus  M - m < (M  . - m , )(l  - a A ) . Repeated  use  of  this  argument 
n n — n-1  n-1  n 

gives 


(M  - * ) < (M.  - a.)  n (1  - mkA . ) < l (l  - mkA. ) < (l  - mkA)n  . 

n n ~ 1 ~ i=2  1 “ i»i  1 “ 


Under  the  weaker  condition  £ A.  ■ , we  still  get 

i*l  1 

1 Im  (M  - m ) • 0 , although  not  necessarily  convergence  at  a geometric 
ry*«  n n n 

rate.  The  condition  £ A.  * • is  sufficient  but  not  necessary  for 

i*l 
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convergence  of  M - m to  0 . For  example,  if  any  one  A,  = - 

n n i mk 

(equivalently  if  any  one  ^as  distribution  r ) then  the  distribu- 

tion of  Z is  r for  all  n > i . 

— n — 
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